Matrix Concentration Inequalities via the Method of Exchangeable Pairs1 by Lester Mackey2,
نویسندگان
چکیده
This paper derives exponential concentration inequalities and polynomial moment inequalities for the spectral norm of a random matrix. The analysis requires a matrix extension of the scalar concentration theory developed by Sourav Chatterjee using Stein’s method of exchangeable pairs. When applied to a sum of independent random matrices, this approach yields matrix generalizations of the classical inequalities due to Hoeffding, Bernstein, Khintchine and Rosenthal. The same technique delivers bounds for sums of dependent random matrices and more general matrix-valued functions of dependent random variables.
منابع مشابه
Matrix concentration inequalities via the method of exchangeable pairs
This paper derives exponential concentration inequalities and polynomial moment inequalities for the spectral norm of a random matrix. The analysis requires a matrix extension of the scalar concentration theory developed by Sourav Chatterjee using Stein’s method of exchangeable pairs. When applied to a sum of independent random matrices, this approach yields matrix generalizations of the classi...
متن کاملDeriving Matrix Concentration Inequalities from Kernel Couplings
This paper derives exponential tail bounds and polynomial moment inequalities for the spectral norm deviation of a random matrix from its mean value. The argument depends on a matrix extension of Stein's method of exchangeable pairs for concentration of measure, as introduced by Chatterjee. Recent work of Mackey et al. uses these techniques to analyze random matrices with additive structure, wh...
متن کاملMatrix Factorization and Matrix Concentration
Matrix Factorization and Matrix Concentration by Lester Wayne Mackey II Doctor of Philosophy in Electrical Engineering and Computer Sciences with the Designated Emphasis in Communication, Computation, and Statistics University of California, Berkeley Professor Michael I. Jordan, Chair Motivated by the constrained factorization problems of sparse principal components analysis (PCA) for gene expr...
متن کاملEfron–Stein Inequalities for Random Matrices
This paper establishes new concentration inequalities for random matrices constructed from independent random variables. These results are analogous with the generalized Efron–Stein inequalities developed by Boucheron et al. The proofs rely on the method of exchangeable pairs. AMS 2000 subject classifications: Primary 60B20, 60E15; secondary 60G09, 60F10.
متن کاملSolving Path Following Problem for Car-Like Robot in the Presence of Sliding Effect via LMI Formulation
One of the main problems of car-like robot is robust path following in the presence of sliding effect. To tackle this problem, a robust mix H2/H∞ static state feedback control method is selected. This method is the well-known linear robust controller which is robust against external disturbance as well as model uncertainty. In this paper, the path following problem is formulated as linear matri...
متن کامل